Skip to content

Wizard Settings Reference

The wizard has two modes: Basic (fewer questions, good defaults) and Advanced (all settings exposed). Basic mode settings are shown to everyone. Advanced settings appear only when you select "Advanced" at the start.

Basic Mode Settings

These are always shown regardless of mode.

Required Settings

SettingDefaultWhat it doesWhy you'd change it
Checkpoint directoryFrom settings or ./checkpointsWhere model weights livePoint to your ACE-Step checkout or custom weights
ModelInteractive pickerWhich model variant to train onPick base, turbo, sft, or a community fine-tune
Dataset directory(none)Folder with preprocessed .pt filesAlways required -- your training data
Output directory(none)Where adapter weights and logs are savedAlways required -- pick a descriptive name

LoRA Settings

SettingDefaultWhat it doesWhy you'd change it
Rank64Number of low-rank dimensions. Higher = more capacity, more VRAMLower for quick tests (16), higher for max quality (128). See [[Training Guide]]
Alpha128Scaling factor (usually 2x rank). Controls adapter strengthKeep at 2x rank unless experimenting
Dropout0.1Dropout on LoRA layers. Prevents overfittingIncrease (0.2-0.3) for very small datasets, decrease (0.05) for large ones
Attention typebothWhich attention layers get adapters: self, cross, or bothself = audio patterns only, cross = text conditioning only. See [[Estimation Guide]] to decide
Target projectionsq_proj k_proj v_proj o_projWhich projections inside each attention blockUse [[Estimation Guide]] results to narrow this down

LoKR Settings (when training LoKR)

SettingDefaultWhat it doesWhy you'd change it
Linear dimension64Analogous to LoRA rankSame guidance as LoRA rank
Linear alpha128Scaling factorKeep at 2x linear dim
Factor-1Kronecker factorization factor (-1 = auto)Leave at auto unless you understand Kronecker factorization
Decompose bothnoDecompose both Kronecker factorsMay improve compression at the cost of capacity
Tucker decompositionnoUse Tucker decompositionAlternative factorization -- experimental
Scalar scalingnoUse scalar scalingExperimental
DoRA weight decomposenoDoRA-style weight decompositionCan improve quality in some cases
Attention typebothSame as LoRASame guidance
Target projectionsq_proj k_proj v_proj o_projSame as LoRASame guidance

Training Settings

SettingDefaultWhat it doesWhy you'd change it
Learning rate1e-4How fast the optimizer moves. For Prodigy, set to 1.0Lower (5e-5) for stability, higher (2e-4) for faster convergence
Batch size1Samples per stepIncrease only if you have VRAM to spare
Gradient accumulation4Steps before weight update. Effective batch = batch_size x thisHigher for smoother gradients, lower for faster updates
Max epochs100Full passes through the datasetMore for small datasets (200-500), fewer for large (50-100)
Warmup steps100LR ramps from 10% to 100% over this many stepsLonger warmup (200+) for stability with large LR
Seed42Random seed for reproducibilityChange to get different training runs

CFG Settings (corrected mode only)

SettingDefaultWhat it doesWhy you'd change it
CFG dropout ratio0.15Probability of replacing conditions with null embeddingsThe base model was trained with 0.15 -- match it. Lower values reduce CFG effectiveness

Logging & Checkpoints

SettingDefaultWhat it doesWhy you'd change it
Save every N epochs10Full checkpoint (adapter + optimizer + scheduler)Lower for safety on long runs, higher to save disk space
Log every N steps10TensorBoard loss/LR loggingLower for more granular curves, higher to reduce overhead
Resume from(empty)Path to a checkpoint to resume fromUse after interrupted training. Points to a checkpoint-epoch-N folder

Advanced Mode Settings

These appear only when "Advanced" is selected at the start of the wizard.

Device & Precision

SettingDefaultWhat it doesWhy you'd change it
DeviceautoGPU selection. Auto picks: CUDA > MPS > XPU > CPUMulti-GPU: pick cuda:0 or cuda:1. Force CPU for debugging
PrecisionautoFloat format. Auto picks: bf16 (CUDA), fp16 (MPS), fp32 (CPU)Force fp32 for debugging NaN issues. fp16 if your GPU lacks bf16

Optimizer & Scheduler

SettingDefaultWhat it doesWhy you'd change it
OptimizeradamwWeight update algorithmadamw8bit saves VRAM. prodigy auto-tunes LR (set LR to 1.0). adafactor for minimal state
SchedulercosineLR decay curve after warmupconstant for Prodigy. linear for steady decay. constant_with_warmup for flat after ramp

Prodigy note: When you select Prodigy, set the learning rate to 1.0 and the scheduler to constant. Prodigy auto-tunes the actual learning rate internally.

VRAM Savings

SettingDefaultWhat it doesWhy you'd change it
Gradient checkpointingyesRecompute activations to save VRAM (~40-60% less, ~10-30% slower)Disable only if you have abundant VRAM and want max speed
Offload encodernoMove encoder/VAE to CPU after setup (~2-4 GB saved)Enable on tight VRAM budgets (10-16 GB GPUs)

Advanced Training

SettingDefaultWhat it doesWhy you'd change it
Weight decay0.01L2 regularization. Prevents overfittingIncrease (0.05) for very small datasets, decrease (0.001) for large
Max grad norm1.0Gradient clipping thresholdIncrease if you see "gradient clipping" warnings everywhere; decrease for stability
Bias modenoneTrain bias parameters: none, all, lora_onlylora_only may marginally improve quality; all trains all biases

Data Loading

SettingDefaultWhat it doesWhy you'd change it
Workers4 (Linux), 0 (Windows)Parallel data loading processesMore workers = faster loading. Windows forces 0 (multiprocessing limitation)
Pin memoryyesPin loaded tensors in CPU for faster GPU transferDisable if low on system RAM
Prefetch factor2Batches each worker prefetches aheadHigher for faster GPUs that consume data quickly
Persistent workersyesKeep workers alive between epochsDisable if you see memory leaks from data loading

Advanced Logging

SettingDefaultWhat it doesWhy you'd change it
TensorBoard dir{output}/runsWhere TensorBoard logs goCustom path if you want all runs in one place
Heavy log every N steps50Per-layer gradient norm loggingLower for debugging training dynamics, higher to reduce overhead
Sample every N epochs0 (disabled)Generate audio samples during trainingNot yet implemented

MiniMax Music 3.0 Studio is an unofficial community project.